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Abstract 

We consider problems of the calculus of variations on unbounded time scales. We prove 
^3 ' the validity of the Euler-Lagrange equation on time scales for infinite horizon problems, and 

a new transversality condition. 
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1 Introduction 

fT^ , Starting with Ramsey's pioneering work |31j . infinite horizon variational and optimal control 

On ■ problems have been widely used in economics (see, e.g., [131 Ell HSl Ull HZl 123 I3D])- On 

the other hand, economics is a discipline in which there appears to be many opportunities for 
CO ' applications of time scales [1] (H [3l |4l [25]. Therefore, it is natural to try to relate the subject of 

, time scales with the study of infinite horizon variational problems. This is the main motivation 

and goal of the present work. 

The study of improper integrals on time scales was introduced by Bohner and Guseinov in [9] . 
For a more general treatment see [53]. However, the use of time scale integrals in the calculus of 
^ I variations has been, so far, restricted to bounded intervals - see [5] [T] [H [HI |26l [27] and references 

^ • therein. In this paper we consider the infinite horizon problem of maximizing the expression 

L{t,x''{t),x'^{t))At (1) 

as T grows to infinity. If T = -l-oo, then the integral ([T]) does not necessarily converge. It 
may diverge to plus or minus infinity or it may oscillate. In such situations the extension of the 
definition of optimality used in the time scale setting (see 171 ) to the unbounded time domain is not 
very useful. For example, if every admissible function x yields an infinite value for functional ([1]), 
then each admissible path could be called an optimal path. To handle this and similar situations 
in a rigorous way, several alternative definitions of optimality for problems with unbounded time 
domain have been proposed in the literature (see, e.g., [HJ [IHl [311 [33j ) ■ In this paper we follow 
Brock's notion of optimality. Therefore, our optimality criterion for the special case T = Z 
coincides with Brock's notion of weak maximality [12] . If T = M, our definition of weak maximality 
coincides with the extension of Brock's notion of weak maximality to the continuous time situation 
[22] . It is worth to point out that in the case where the functional ([T]) converges for all admissible 
paths, the weak maximal path is optimal in the sense of the standard definition of optimality. 

Main result of the paper gives necessary conditions of weak maximality for infinite horizon 
variational problems on a generic (unbounded) time scale (cf. Theorem [4]). 

*Submitted 6-October-2009; Accepted 19-March-2010 in revised form; for publication in Optimization Letters. 
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2 Preliminaries 



In this section we introduce basic definitions and results that will be needed in the sequel. For a 
more general presentation of the theory of time scales we refer the reader to the books [TUl [TT] . 
As usual, R, Z, and N denote, respectively, the set of real, integer, and natural numbers. 

A time scale T is an arbitrary nonempty closed subset of R. Besides standard cases of R 
(continuous time) and Z (discrete time), many different models of time are used. For each time 
scale T the following operators are used: 

• the forward jump operator cr : T ^ T, a(t) := inf{s £ T : s > t} for t 7^ supT and 
(T(supT) = supT if supT < +00; 

• the backward jump operator p : T — >■ T, p{t) :— sup{s € T : s < i} for t 7^ inf T and 
p(inf T) = inf T if inf T > -00; 

• the forward graininess function /i : T — > [0, oo[, fi(t) := ait) — t. 

Example 1. IfT = R, then for any t E M., <j{t) = t = p{t) and ii{t) = 0. //T = Z, then for every 
t e Z, cr(t) = < + 1, pit) = < - 1 and fi{t) = 1. 

A point i e T is called right-dense, right-scattered, left-dense and left- scattered if a{t) = t, 
a{t) > t, p{t) = t, and p{t) < t, respectively. We say that t is isolated if p{t) < t < a{t), that 
t is dense if p{t) = t = (y{t). If supT is finite and left-scattered, we define T'^ := T \ {supT}. 
Otherwise, T'' := T. 

Definition 1. Let / : T — >■ R and < G T'^. The delta derivative of f at t is the real number f^{t) 
with the property that given any e there is a neighborhood U oi t (i.e., U =]t — 5,t -\- 5[nT for 
some S > 0) such that 



for all s e U. We say that / is delta differentiable on T provided f^[t) exists for all t e T''. 

We shaU often denote /^(t) by ^J{t) if / is a composition of other functions. The delta 
derivative of a function / : T R" (n e N) is a vector whose components are delta derivatives of 
the components of /. For / : T — > AT, where X is an arbitrary set, we define f '■= f o a. 

For delta differentiable / and 5, the next formulas hold: 



Remark 1 . If T = R, then / : R — ?> R is delta differentiable at t S R if and only if / is differentiable 
in the ordinary sense at t. Then, f^{t) = f'{t). If T = Z, then / : Z — T' R is always delta 
differentiable at every t e Z with f^{t) = fit + 1) - f{t). 

Let a, & € T, a < 6. We define the interval [a, b] in T by 

[a,b]:={teT ■.a<t< b}. 
Open intervals, half-open intervals and unbounded intervals in T are defined accordingly. 
Definition 2. A function : T — > R is called a delta antiderivative of / : T ^ R provided 



|(/(C7(<)) - /(.)) - /^(<)(a(<) - .)| < s\ait) - .| 



r(t)=/(t)+MO/^W, 
(/<?)^W = /^W3^(<) + ./(%^(t) 
= .f^it)9it) + f^t)g^it). 



F^it)^fit), VteT". 

In this case we define the delta integral of / from a to & (a, 6 G T) by 
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In order to present a class of functions that possess a delta antiderivative, the following defi- 
nition is introduced: 

Definition 3. A function / : T — M is called rd- continuous if it is continuous at the right-dense 
points in T and its left-sided limits exist at all left-dense points in T. A function / : T — >■ R" is 
rd-continuous if all its components are rd-continuous. 

The set of all rd-continuous functions / : T — >■ R" is denoted by Crci(T,K"'), or simply by Crd- 
Similarly, Cj^(T,R") and C;';^ will denote the set of functions from Crd whose delta derivative 
belongs to Crd- 

Theorem 1 ([10 ). Every rd-continuous function has a delta antiderivative. In particular, if 
a G T, then the function F defined by F{t) = /(T)Ar, t d T, is a delta antiderivative of f . 

Theorem 2 (JW). If a,b,c e T, a < c < b, a e R, and f,g G Crd{T,R), then 
''\f{t)+g{t))M= f f{t)M+ [\{t)At; 



Yf{t)At = a / f{t)At; 



f{t)At; 



nb pa 

/ f{t)At ^ / 
f f{t)At^Q; 

J a 



fit) At = / fit) At + / fit) At; 



b 



6. If fit) >0 for alia <t< b, then I fit) At > 0; 



'f^t)g^it)At = [if9)it)]lzl ~ f f^it)git)At; 
8- f fit)9^mt^[ifg)it)]tl- f f^it)g^t)At; 

J a J a 

9. Ift^T\ then T^'V^Ar - /i(t)/(t). 



Definition 4. If a G T, supT — +oo and / G Crdi[a, -|-oo[,R), then we define the improper delta 
integral by 

f -f-oo 



/(i)At:= lim / fit)At 

provided this limits exists (in R R U {— oo,+cx)}). We say that the improper delta integral 
converges if this limit is finite; otherwise, we say that the improper delta integral diverges. 

In [9] the reader may find many examples and results involving delta improper integrals. 
The following result will be very useful in the proof of our main result (Theorem 2]). 

Theorem 3 ( 23 ). Let S and T be subsets of a normed vector space. Let f be a map defined 
on T X S , having values in some complete normed vector space. Let v be adherent to S and w 
adherent to T. Assume that: 

L \\mx^v fit, x) exists for each t G T; 

2. limt_^u) fit, x) exists uniformly for x € S . 

Then the limits limt_^^ lim^j-^^ /(t, x), lima;_>„ limt_>.u, /(i, a;), and ^iT[i^t.x)^{v,w) fit, x) all exist 
and are equal. 
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3 Main results 

In this section we assume that T is a time scale such that supT = +00. In what foUows we will 
suppose that a, T,T' G T are such that T > a and T' > a. By and d^L we denote, respectively, 
the partial derivative of •, •) with respect to its second and third argument. Let us consider 
the following variational problem on T: 

/+00 
— > max 

x[a) = Xa 

where {u,v) -5> L(t,u,v) is a CHR^",R) function for any t £ T, d3L{t,x''{t),x^{t)) is delta 
differentiable for all x S Ci^(T,E"), n e N, and Xa S M". 

Definition 5. We say that x is an admissible path for problem ^ if and only if x e C^^(T,M") 
and x{a) — Xa- 

We use the following notion as our optimality criteria. 

Definition 6 (weak maximality) . We say that 2;* is weakly maximal to problem ^ if and only 
if a;* is an admissible path and 

^\un^M^£ [L{t,x%t),x^{t)) - L{t,xl{t),xt{t)W < 

for all admissible path x. 

Lemma 1. Let g e Crd(T,R). Then, 

^\im ^,nf^y g{t)Tj''{t)At ^ for all r/eC,.d(T,M) such that r/(a) = 
if and only if g{t) = on [a, +oo[. 

Proof. The implication "<=" is obvious. Let us prove the implication Suppose, by contra- 

diction, that g{t) ^ 0. Let to be a point on [a, +oo[ such that .g(io) 7^ 0; suppose, without loss of 
generality, that 5(^0) > 0- 

Case I. If to is right-dense, then g is also positive in [ioi^i] for some ti > to- Define 



Then 



{t-to)iti-t) te[to,ti] 

otherwise . 



T^-l-00 T'>T 

which is a contradiction. 

Case II. Suppose that to is right-scattered 

1. If a{to) is right-scattered, define 
Then 



liin inf / g{t)v^t)At - f ' g{t)ij^{t)At > 

"""^ — J a J tn 



g{to) t = a{to) 
otherwise 



lim inf / g{t)r,''{t)At^ g{t)T^'' {t)At ^ ii{to)g{to)g{to) > 



which is a contradiction. 
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2. Suppose that (7(^0) is right-dense. Two situations may occur: 

(a) gia{to)) ^ 0; 

(b) giaih)) - 0. 

In case (a), we can assume, without loss of generahty, that g{a(to)) > 0. Then g is also 
positive in [cr(to),^2] for some t2 > cr(io)- Define 



In this case 



{t ~ aito))it2 - t) te[aito),t2] 
otherwise 



hin inf / g{t)v-{t)At = f ' g{t)v-{t)At > 
which is a contradiction. 

Suppose we are in case (b). Two situations may happen: 
(i) g{t) = on [cr(to),i3] for some ^3 > a-(to); 
{ti) Vh > <j{to) 3t e [a{to),h] g{t) ^ 0. 
In case (i) define 

r 5(^0) t^cT{ta) 

[ otherwise 

for some function ip e Crd satisfying the conditions 1^9(^3) — and ip{(7{tQ)) — g{ta)- It 
follows that 

lim inf / g{t)f^''(t)At= g{i)T^'' {t)At ^ y.(t^)g{to)g{h) > Q 

which is a contradiction. 

Suppose we are in case (m). Since (T(to) is right-dense, there exists a strictly decreasing 
sequence 5* = {sk : G N} C T such that limfc_^oo Sk — cr(io) and g{sk) ^ 0, Vfc G N. If 
there exists a right-dense Sk, then go to Case I with to '.— Sk (and we get a contradiction). 
If all points of the sequence are right-scattered, then go to Case II with to := Sj for some 
j £ N. Since (7(^0) is right-scattered, we are in situation 1 and we obtain a contradiction. 

Therefore, we may conclude that g = on [a, +00 [. □ 

Theorem 4. Suppose that the optimal path to problem exists and is given by . Let p € 
C^i^(T,M") be such that p{a) = 0. Define 

r L{t, x% it) + {t) , jt) + ep^ {t))-L{t, xl it) , xf (t) ) 
l/(e,T) := inf / [L(t, <(t) a:f (i) -t- ep^(t)) - <(i), (t))] At 

^ — ^ J a 

!/(£) := lim V{e,T)- 

T— !.+oo 

Suppose that 

1. lim ^ exists for all T; 

e->0 e 
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V(e,T) 

2. lim ^ exists uniformly for e; 

T^+oo e 

3. For every T' > a, T > a, and e G M \ {0}, there exists a sequence (A(e, T^))^gpj such that 

Hm A(£,T^)= inf A(e,r') 

n— >+oo T'>T 

uniformly for e. 
Then satisfies the Euler- Lagrange equation 

^^d^L{t,x%t),x''{t))^d2L{t,x%t),x''{t)), VteK+cx)[ (3) 
and the tranversality condition 

lim inf (93L(r',a;'"(r'),a;'^(T'))a;(r') = 0. (4) 

Remark 2. Similarly to the classical context T = K hypotheses 1,2, and 3 of Theorem 2] are 
impossible to be verified a priori because is unknown. In practical terms such hypotheses are 
assumed to be true and conditions ^ and (jU are applied heuristically to obtain a candidate. If 
such a candidate is, or not, a solution to the problem is a different question that always require 
further analysis (see Examples [H and ■ 

Proof. Using our notion of weak maximality, if a;* is optimal, then V{£) < for every e G M. Since 
V{Q) = 0, then is an extremal point of V. If V is differentiable at i = 0, we may conclude that 
V'{0) = 0. We now note that 

V'iO) = lim lim lim M 

= lim lim Y.SEi — \ (by hypothesis 1 and 2 and Theorem [3l) 

T-> + OOE^0 £ 

lim lim inf A{£,T') 

T^+aoe^OT'>T 

= lim lim hm ^(£,T' ) (by hypothesis 5) 

T^+oo e— >0 n— i.+oo 

= lim lim lim^(£,T,') (by hypothesis 5 and Theorem [3|) 
= lim inf lim^(e,T') (by hypothesis 5) 

hm inf lim C ^(^^ ^* (0 + (<) , jt) + £p^ jt)) - L{t, x- jt) , (t)) 

T^+oo T'>T £->0 7^ £ 

hm inf lim + "^^^^^ + '^^^^^^ ~ ^? W) Af 

= ^lim inf / [d2L{t,x:{t),xf{t))p^t)+d3L{t,x:{t),xf{t))p^(t)]At 

T->+cioT'>T 

= Mm inf ki(i,<(i),^fWKW-^93L(t,x-(t),xf(i))p"(i)l A< 

+a3L(T',<(T'),xf (r')MT')} (by item 8 of Theorem [2] and p(a) = 0). 



Hence we may conclude that 
inf <! / 

T->-+ 



hrn^^nf^M'' (^92i(.) - Aa3L(.)^ p-(t)At + a3i:(T', <(T'), xf (r')MT') U (5) 



where we denote (•) := (i, xj(i), x^(t)). Since ^ holds for all p g C^^ such that p{a) ~ 0, then, 
in particular, ([5]) holds for p satisfying also p{T') = 0. Therefore, 
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Denote 

\dxi dXnJ \dyi dy„ 

Choosing p = (pi, • • • ,Pn) such that p2, ■ • • ,Pn = 0, we obtain from ([6]) that 



lim inf / A|^(.))p-(i)Ai^O. 

Using Lemma [1] we conclude that 

dL , . A dL , . 

This procedure can be similarly used for the other coordinates and we obtain the Euler-Lagrange 
equations: 

dL , . A dL , . 

d^^'^-AtW.^'^-'^ WeK+oo[ 

for z = 2, 3, . . . , n. These n Euler-Lagrange equations can be written in the condensed form 

d2Lit,x^At),xtit))-^^d3L{t,xUt),xt{t))^0, yte[a,+^[. (7) 
The Euler-Lagrange equation ([7]) and equation ([5]) shows that 

hm inf 93i(T',<(r'),xf(r'))p(r') = o. (8) 

Next we consider a special curve p defined by 

p{t) — a{t)x^,{t), V<e[a,+oo[ 

where a : [a, -|-cx)[— > M is a C^^ function satisfying a{a) = and there exists Tq G T such that 
a{t) = /3 e R \ {0}, for aU t > Tq. By equation ^ we conclude that 

- ^liin^^nf^a3L(T',<(T'),xf(r'))a(r')a;.(T') 

and therefore 

hm inf d3L{T',x:iT'),xtiT')))x,ir) = 0, 

T-i.+ooT'>T 

proving that a;* satisfies the transversality condition ([4]). □ 

4 Illustrative examples 

Example 2. Consider the problem 
f +00 

[(x'^(t) - a)^ At — ^max, x{a) = a , 

where a > and /3 > 0. Since L(t,x"' ,x^) = {x'^ — a)^ + fix^ we have d2L — 2{xf — a) and 
d^L — p. From Theorem^the Euler-Lagrange equation is 

2{x''{t) - a) = 0, Vt e [a, +00 [ , 

that is, x"^ (t) = a, Vt G [a, +oo[. As x{a) — a, we have x{t) — Vt £ [a, +(X)[. Observe that the 
transversality condition ^ is not satisfied, because 

lim inf d3L(T',x''(T'),x^(T'))x(T') = f3a > 0. 

T^+ocT'>T 
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The reason why we obtain this contradiction is that assumptions of Theorem^ are violated. Con- 
sider L{t,x'^{t) + ep''{t),x^{t) + sp^{t)) - L{t,x'^{t),x^{t)). Substituting x{t) = a into it, we 
have 

L{t,x%t)+ep''{t),x^{t)+ep^{t)) - L{t,x'' {t),x^{t)) = e^p'' {t)f + Pep^ {t) . 

Hence, 

^ ^ inf r' !liP:ml±^fP^At ^ inf r ieip^t)r + ^pHt)) At. 

e T'>T 7q e T'>T Ja 

Choosing p such that p{a) — and there exists Tq > a so that p(t) = c > for t > Tq, we obtain 



V{e,T) 



T 



£ 

Therefore, assumption 2 of Theorem is violated. 
Example 3. Consider the problem 

f + 00 



ec'^Ai + fic. 



^J\ + {x^{t)Y At max , x{0) = A. (9) 



Since 



L(^,X^X^) = -.^l + (xA)2, 

we have 

dzL = , 52^ = 0. 

Using the Euler- Lagrange equation ^ we obtain 

i^{t) = d^Ji + {x^{t)Y, \ft e [o,+oo[ 

for some d S R. Solving the latter equation with initial condition x{0) = A we obtain x{t) — at+A, 
where a £ M. In order to determine a we use the tranversality condition which can be rewritten 
as 

ry 

lim inf jryT' + A) = Q. 

T^+ocT'>T y/l + c? 

Hence, a = and (t) — A is a candidate to be a maximizer. Observe that 
lim inf / [L{t,x^{t),x'^it))-Lit,x:{t),x^{t)]At 



T 



'"^^Mrf, (l - \/^^(^) At < 



for every admissible x. Therefore, by Definition\S\we have that x^(t) — A is indeed the solution 
to problem ^ . 



5 Conclusion and future work 

We considered problems of the calculus of variations on unbounded time scales. Main result 
provides a new transversality condition. Examples illustrating the application of the new necessary 
optimality conditions are given in detail. In the particular case T — Z, our transversality condition 
gives the discrete time condition obtained by Michel in [28] : for the continuous time case, i.e., for 
T = R, we obtain the result by Kamihigashi [21]. Recently, Okumura et al. [29] generalized the 
results of Kamihigashi to higher order differential problems. The question of obtaining necessary 
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optimality conditions that extend the results of |29) to higher-order infinite horizon problems on 
time scales remains an interesting open question. While clear that the Euler-Lagrange equations 
proved in |f8[l27) remain valid in the infinite horizon case, the generalization of our transversality 
condition Q to higher-order variational problems on time scales is a non-trivial question requiring 
further investigations. 
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